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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Box Patent Application 

Assistant Commissioner for Patents 

Washington, D.C. 20231 

NI< W APPLICATION TRANSMITTAL 

Transmitted herewith for tiling is the patent application of 
Invenlor(s): p eter SLADEN 



WARNING: 37 C.F.R. § 1.41(a)(1) points out: 

'(a) A patent is applied for in tfw name c 



names of Vie actual inventor or Inventors. 



•(1) The inventorship of a nonprovisional application is that inventorship set forth in the oath or 
declaration as prescribed by § i.63. except as provided for in § 1.53(d)(4) and § 1.63(d). If an 
oath or declaration as prescribed by § 1.63 Is not filed during tins pendency of a nonprovisional 
application. tfx> inventorship is that inventorship set forth in the application papers filed pursuant 
to § 1.53(b), unless a petition under (Ms paragraph accompanied by the fee set forth In § 1.170 
is filed supplying or dianging tfw name or names of tin inventor or inventors. ' 



IMAGE SENSOR 



CERTIFICATION UNDER 37 C.F.R. I 1.10* 

(Expre** Mall label number I* mmnOmlory.) 
(Expre** Mall certification la optional.) 

I J>eroby certify thai this New Application Transmittal and the documents referred to as attached therein are being 

deposited wHh the United States Postal Service on this date December 22, 1999 , In an envelope 

es 'Express Mail Poet Office to Addressee," mailing Label Number EL067144355US , ad- 
dressed to llw: Assistant Commissioner lor Patents, Washington. D.C. 20231. 

M aureen Egan 

(type or print name of person mailing paper) 

Signature of person malting paper 

WARNING: Certificate of mailing (first class) or facsimile transmission procedures of 37 C.F.R. § 1.6 cannot be 

used to obtain a dale of mailing or transmission for this correspondence. 
'WARNING: Eacn paper or foe filed by 'Express Mail' must have the number of the 'Express Mail' mailing label 
placed thereon prior to mailing. 37 C.F.R. § 1.10(b). 

"Since the filing of correspondence under §1.10 without the Express Mail mailing label thereon 
is an oversight ti\at can be avoided by the exerdse of reasonable cere, requests for waiver of this 
roquhmrwit will not be granted on petition. " Notice of Oct. 24, 1996, 60 Fed. Reg. 56,439, at 56.442. 
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1. Typo of Application 

This new application Is for a(n) 

(check one applicable Kern below) 
QD Original (nonprovisional) 

□ Design 
□ Plant 

WARNING: Do not use this transmittal (or a completion in the U.S. of an International Application undor 35 
U.S.C. § 371(c)(4). unless the International Application is being tiled as a divisional, continuation 
or continuation-in-part application. 

WARNING: Do not use this transmittal for the filing of a provisional application. 

NOTE: If one of the following 3 items apply, then complete and attach ADDED PAGES FOR NEW APPLICATION 
TRANSMITTAL WHERE BENEFIT OF A PRIOR U.S. APPLICATION CLAIMED and a NOTIFICATION 
IN PARENT APPLICATION OF THE FILING OF THIS CONTINUATION APPLICATION. 

□ Divisional. 

□ Continuation. 

□ Contlnualion-ln-part (C-l-P). 

2. Benefit of Prior U.S. Applicatlon(s) (35 U.S.C. §§ 119(e). 120, or 121) 

NOTE: A nonprovisional application may claim an invention disclosed in one or more prior Tiled copending 
nonprovisional applications or copending international applications designating the United States of 
America. In order lor a nonprovisional application to claim the benefit of a prior Wed copending 
nonprovisional application or copending international application designating the United States of 
America, each prior application must name as an Inventor at least one inventor named in the later filed 
nonprovisional application and disclose the named inventor's invention claimed In at least one claim 
of the later Tiled nonprovisional application in the manner provided by the first paragraph of 35 U.S.C. 
§112. Each prior application must also be: 

ft) An international application entitled to a Tiling date in accordance with PC T Article 11 and 
designating the United Slates of America; or 

(ti) Complete as set forth in § 1.51(b); or 

(w) Entitled to a Tiling dale as set forth in § 1.53(b) or § 1.53(d) and include the basic Tiling fee set 
forth in § 1.16; or 

(iv) Entitled to a filing date as set forth in § 1.53(b) and have paid therein the processing and retention 
fee set forth in § 1.21(1) within the time period set forth in § 1.53(1). 
37 C.F.R. § 1.78(a)(1). 

NOTE: If the now application being transmitted is a divisional, continuation or a continuation-in-part of a parent 
case, or where the parent case is an International Application which designated the U.S., or benefit 
of a prior provisional application is claimed, then check the following item and complete and attach 
ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICA- 
TION^) CLAIMED. 

WARNING: If an application claims the beneTit of the Tiling date of an earlier filed application under 35 U.S.C. 

§§ 120, 121 or 365(c), the 20-year term of that application will be based upon the filing date of 
the earliest U.S. application that the application makes reference to under 35 U.S.C. §§ 120, 121 
or 365(c). (35 U.S.C. § 154(a)(2) does not take Into account, for the detenvinetion of the patent 
term, any application on which priority Is claimed under 35 U.S.C. §§ 1 19, 365(a) or 365(b).) For 
a c-l-p application, applicant should review whether any claim in the patent that will issue is 
supported by an earlier application and, if not, the applicant should consider canceling the reference 
to the earlier Wed application. Vie term of a patent is not based on a clalm-by-cleJm approach. 
Soe Notice of April 14, 1995. 60 Fed. Reg. 20, 195, at 20,205. 
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WAnNINO: Whon tlie last day of pendency of a provisional application (alls on a Saturday, Sunday, or Federal 
holiday within the District of Columbia, any nonprovlslonel application claiming benefit of the 
provisional application mutt be filed prior to the Saturday, Sunday, or Federal holiday within Uw 
District of Columbia. Soe 37 C.F.R § 1.76(a)(3). 

□ The new application being transmitted claims Ihe benefit of prior U.S. applica- 
tions). Enclosed are ADDED PAGES FOR NEW APPLICATION TRANSMITTAL 
WHERE BENEFIT OF PRIOR U.S. APPLICATION(S) CLAIMED. 

3. Papers Enclosed 

A. Required for filing dale under 37 C.F.R. § 1.53(b) (Regular) or 37 C.F.R. § 1.153 
(Design) Application 
9 Pages of specification 
2 Pages of claims 
2 Sheets of drawing 
WMNINO: DO NOT submit original drawings. A high quality copy of the drawings slyould be supplied when 
Filing a patont application. Ihe drawings tftet are submitted to tlie Office must be on strong, white, 
smooth, and non-slvny paper and moot l/w standards according to § 1.84. If corrections to //w 
drawings are necessary, lltey sliould be made to the original drawing and a high-quality copy of 
the corrected original drawing ttwn submitted to tlte OlFice. Only one copy Is required or desired. 
For comments on proposed then-new 37 C.F.R. § 1.84, see Notice of March 9. 1988 (1990 O.G. 
57-62). 

NOTE: 'Identifying Indicia, if provided, sliould Include the application number or the title of the Invention, 
Inventor's name, docket number (if any), and the name and telephone number of a person to call If 
tlw Office is unable to match tlie drawings to the proper application. This Information should be placed 
on the back of each slioel of drawing a minimum distance of 1.5 cm. (5/8 Inch) down from the top 
of t/w page . . ." 37 C.F.R. § 1.84(c)). 

(complete the following, if applicable) 

□ The enclosed drawlng(s) are pholograph(s), and there Is also attached a 
"PETITION TO ACCEPT PHOTOGRAPH(S) AS DRAWING(S)." 37 C.F.R. 
§ 1.84(b). 

□ fomial 

□ Informal 

D. Other Papers Enclosed 

Pages of declaration and power of attorney 

L_ Pages of abstract 

Olhor 

4. Additional papers enclosed ' 

□ Amendment to claims 

□ Cancel In this applications claims before 

calculating the filing fee. (At least one original Independent claim must be 
retained for filing purposes.) 

□ Add the claims shown on the attached amendment. (Claims added have 
been numbered consecutively following the highest numbered original 
claims.) 

□ Preliminary Amendment 

E) Information Disclosure Statement (37 C.F.R. § 1.98) 

EJ Form PTO-1449 (PTO/SB/00A and 00B) 

0 Citations , 
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O Declaration of Biological Deposit 

□ Submission of "Sequence Listing," computer readable copy and/or amendment 
pertaining thereto for biotechnology Invention containing nucleotide and/or 
amino acid sequence. 

□ Authorization of Altomey(s) to Accept and Follow Instructions from Representa- 
tive 

□ Special Comments 

□ Other 

5. Declaration or oalh (Including power of attorney) 

NOTE: A newly executed declaration is not required in a continuation or divisional application provided that 
the prior nonprovisional application contained a declaration as required, Uie application being Wed is 
by all or fewer than all the Inventors named in the prior application, there is no new matter in the 
application being filed, and a copy of ilia executed declaration filed In the prior application {showing 
the signature or an indication thereon that it was signed) is submitted. The copy must be accompanied 
by a statement requesting deletion of the names ofpersonfs) who are not inventors of the application 
being filed. If the declaration in the prior application wbs filed under § 1.47, then a copy of that 
declaration must be filed accompanied by a copy of the decision granting § 1.47 status or. If a nonsigning 
person under § 1.47 has subsequently joined In a prior application, then a copy of the subsequently 
executed declaration must be filed. See 37 C.F.R. §§ 1.63(dX1H3). 

A/OfF: A declaration filed to completo an application must be executed, identify the specification to which it 
Is directed, identify each inventor by full name including family name and at hast one given name, without 
abbreviation togetlwr with any otlwr given name or initial, and the residence, post office address and 
country or ciiizenslvp of each inventor, and state wliether l/w inventor is a sole or joint inventor. 37 
C.F.R. § l.63(a)(1H4). 

□ Enclosed 
Executed by 

(check all applicable boxes) 

□ inventor(s). 

□ legal representative of inventor(s). 
37 C.F.R. §§ 1.42 or 1.43. 

□ joint Inventor or person showing a proprietary 
interest on behalf of inventor who refused to sign 
or cannot bo reached. 

□ This Is the petition required by 37 C.F.R. § 1.47 and the statement 
required by 37 C.F.R. § 1.47 Is also attached. See item 13 below 
for fee. 

OP Not Enclosed. 

/VOTE: Wltere the filing is a completion in i/je 17. S. of an International Application or where tlx) completion of 
life U.S. application contains subject matter In addition to the International Application, the application 
may be treated as a continuation or continuation-in-part, as the case may be, utilizing ADDED PAGE 
FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICATION CLAIMED. 

(5 Application Is made by a person authorized under 37 C.F.R. § 1.41(c) on 
behalf of all the above named inventors). 

(The declaration or oalh, along with the surcharge required by 37 C.F.R. § 1.16(e) 
can be Hied subsequently). 

□ Showing that the filing Is authorized. 

(not required unless called into question. 37 C.F.R. § 1.41(d)) 
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6. Inventorship Statement 

WARNING: II l/w named inventors are each not the inventors of all the claims an explanation, including tin 
ownership of the various claims at the time the last claimed invention was made, should be 
submitted. 

The inventorship lor all the claims in this application are: 

□ The same. 

or 

□ Not the same. An explanation, including the ownership of the various claims at 
the time the last claimed invention was made, 

□ is submitted. 

□ will be submitted. 

7. Language 

NOTE: An application including a signed oath or declaration may be filed in a language other than English. 
An Englislt translation of the non-English language application end the processing foe of $130.00 
roquirod by 37 C.F.Il § 1.17(k) is roquirod to bo Plod with the application, or within sucl} time as may 
bo set by the Office. 37 C.F.Il § 1.52(d). 

□ English 

□ Non-English 

□ The attached translation includes a statement thai the translation Is accu- 
rate. 37 C.F.R. § 1.52(d). 

8. Assignment 

, , , Nokia Mobile Phones Ltd. 

□ An assignment ol the Invention to _ 



□ is attached. A separate □ "COVER SHEET FOR ASSIGNMENT (DOCU- 
MENT) ACCOMPANYING NEW PATENT APPLICATION" or □ FORM PTO 
1595 is also attached. 

^ will follow. 

NO IE: 'If en assignment is submitted with a new application, send two separate letters-one for tlie application 

and one lor the assignment.' Notice of May 4, 1990 (1114 O.G. 77-78). 
WARNING: A newly executed 'CERTIFICATE UNDER 37 C.F.R. § 3.73(b)' must be filed when a continuation- 
in-part application is filed by an assignee. Notice of April 30, 1993, 1150 O.G. 62-64. 
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9. Certified Copy 

Certified copy(les) of application^) 



Country 


Appln. No. 


Filed 


United Kingdom 


9828544.8 


23 December 1998 


Country 


Appln. No. 


Filed 


Country 


Appln. No. 


Filed 



from which priority Is claimed 
EI Is (are) attached. 
□ will follow. 

NOTE: 77»o foreign application forming the bash for the claim (or priority must be referred to In tfw oath or 

declaration. 37 C.F.R. § 1.55(a) and 1.63. 
NOTE: Tills Item Is for any foreign priority for which the application being filed directly relates. If any parent 

U.S. application or International Application from which this application claims benefit under 35 U.S.C. 

§ 120 Is Itself entitled to priority from a prior foreign application, then complete Item 18 on the ADDED 

PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICATIONS) 

CLAIMED. 

10. Fee Calculation (37 C.F.R. § 1.16) 
A. C3 Regular application 



CLAIMS AS FILED 


Number filed 




Number Extra 


Rate 


Basic Fee 
37 C.F.R. § 1.16(a) 
$760.00 


Total 

Claims (37 C.F.R. 
§ 1.16(c)) 


10 _ 


20 = 0 x 


$ 18.00 


0 


Independent 
Claims (37 C.F.R. 
§ 1.16(b)) 


1 - 


3 = Ox 


$ 78.00 


0 


Multiple dependent clalm(s), 
If any (37 C.F.R. § 1.16(d)) 


+ 


$260.00 





□ Amendment cancelling extra claims Is enclosed. 

□ Amendment deleting multiple-dependencies is enclosed. 

□ Fee for extra claims Is not being paid at this time. 

NO TE: If the fees lor extra claims are not paid on Tiling they must be paid or the claims cancelled by amendment, 
prior to the expiration of the time period set for response by the Patent and Trademark Office In any 
notice of foe deficiency. 37 C.F.R. § 1.16(d). 

Filing Fee Calculation $ 760.00 

B. □ Design application 

($310.00—37 C.F.R. § 1.16(f)) 

Filing Fee Calculation $ 

C. □ Plant application 

($400.00—37 C.F.R. § 1.16(g)) 

Filing fee calculation $ 
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11. Smoll Entlly Slalomonl(s) 

□ Statoment(s) lhal this is a filing by a small entity under 37 C.F.R. § 1.9 and 1.27 
Is (are) attached. 

WARNING: "Status as a small entity must bo specifically establisfwd In each application or patent in whlcli 
Iho status is available end desired. Status as a small entity In one application or patent does not 
affect any ollwr application or patent, including applications or patents which are directly or 
Indirectly dependent upon the application or patent In which the status has bom establislied. Tlie 
refiling ol an application under § 1.53 as a continuation, division, or continuation-in-part (including 
a continued prosecution application under § 1.53(d)), or .the filing of a reissue application requires 
anew determination as to continued entitlement to smalt enllty status for the continuing or reissue 
application. A nonprovlslonaf application claiming benefit under 35 U.S.C. § 119(a), 120, 121, or 
305(c) of a piior application, or a reissue application may rely on a statement filed In tho prior 
application or in the patent if tho nonprovisional application or the reissuo application Includes a 
rolerence to tho statement in the prior application or In the patent or includes a copy of tlw 
statement in tho prior application or in the patent and status as a small entity is stilt proper and 
dosirod. Iho payment of tho smalt entity basic statutory filing loo will bo treated as such a reforonce 
tor purposes of this section.' 37 C.F.fl § 1.28(a)(2). 

WARNING: 'Small entity status must not bo ostablishod when Urn porson or persons signing l/io . . . stetomont 
can unequivocally make tlw required soif-coitificaUon.' M.P.E.P., § 509.03, Glh od., rev. 2, July 
1996 (omptiasis added). 

(complete tlw fallowing. If applicable) 

□ Status as a small entity was claimed In prior application 
/ , filed on 



from which benefit 



Is being claimed for this application under: 
35 U.S.C. 5 □ 119(e), 

□ 120, 

□ 121, 

□ 305(c), 

and which status as a small entity Is still proper and desired. 
□ A copy of tho statement In the prior application Is included. 
Filing Fee Calculation (50% of A, B or C above) 

$ 

NOfE: Anyexcoss olt)to lull too paid will be refunded if small entitiy status Is establlslwd and a refund request 
are Plod within 2 months of tlw date of timely payment of a full fee. The two-month period is not 
extendable under § 1. 136. 37 C.F.R. § 1.28(a). 

12. Roquest for InlornaUonnl-Typo Search (37 C.F.R. § 1.104(d)) 

(complete, If applicable) 

□ Please prepare an International-type search report for this application at the time 
when national examination on tho merits lakes place. 
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13. Foe Payment Being Made at This Time 

□ Not Enclosed 

□ No filing fee Is to be paid at this time. 

(This and the surcharge required by 37 C.F.R. § 1.16(e) can be paid 

subsequently.) 
13 Enclosed 

O Filing fee $ 

Q Recording assignment 

($40.00; 37 C.F.R. § 1.21(h)) 

(See attached "COVER SHEET FOR 

ASSIGNMENT ACCOMPANYING NEW 

APPLICATION".) $ 

□ Petition fee for filing by other than all the 
Inventors or person on behalf of the inventor 
where Inventor refused to sign or cannot be 
reached 

($130.00; 37 C.F.R. §§ 1.47 and 1.17(1)) $ 

□ For processing an application with a 
specification in 

a non-English language 

($130.00; 37 C.F.R. §§ 1.52(d) and 1.1 7(k)) $ 

□ Processing and retention fee 

($130.00; 37 C.F.R. §§ 1.53(d) and 1.21(1)) $ 

□ Fee for International-type search report 

($40.00; 37 C.F.R. § 1.21(e)) $ 

NOTE: 37 C.F.R. § 1.210) establishes a tee for processing and retaining any application that is abandoned for 
failing to complete the application pursuant to 37 C.F.R. § 1.63(0 end this, as well as the changes to 
37 C.F.R. §§ 1.53 and 1.78(a)(1), Indicate that In order to obtain the benefit of a prior U.S. application, 
either the basic filing fee must be paid, or the processing and retention fee of § 1.21(1) must be paid, 
within 1 year from notification under § S3(l). 

Total fees enclosed $ 760 • 00 

14. Method of Payment of Foes 

H Check In the amount of $ 760^00 



□ Charge Account No. In the amount of 

$ 

A duplicate of this transmittal Is attached. 
NOTE: Fees sfwutd be itemized in such a manner that it is clear for which purpose Urn foes aw paid. 37 C.F.R. 
§ 1.22(b). 
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15. Authorization to Charge Additional Fees 
WARNING: If no fees are to bo paid on King, f/ie following items sfiould not bo completed. 
WARNING: Accurately count daims, especially multiple dependent claims, to avoid unexpected high cliargos, 
if extra claim cliargos are authorized. 

IxJ The Commissioner is hereby authorized to charge the following additional fees 
by this paper and during the entire pendency of this application to Account No. 
16-1350 : 

U 37 C.F.R. § 1.10(a), (f) or (g) (filing foes) 
Ki 37 C.F.R. § 1.10(b), (c) and (d) (presentation of extra claims) 
Uecauso additional loos lor excess or multiple dependant claims not paid on Filing or on later presentation 
must only be paid or these claims cancelled by amendment prior to Die expiration of the time period 
set for response by the PTO in any notice of fee donclency (37 C.F.R. § 1.16{d)), it might bo best not 
to authorize l/w PTO to cliargo additional daim fees, except possibly wlmn dealing with amendments 
after final action. 

£3 37 C.F.R. § 1.1G(e) (surcharge lor filing the basic filing fee and/or declaration 

on a dale later than Ihe liiing date ol the application) 
& 37 C.F.R. § 1.17(a)(1H5) (extension fees pursuant to § 1.136(a)). 

□ 37 C.F.R. § 1.17 (application processing fees) 

". . .A written request may be submitted in an application that Is an authorization to treat any concurrent 
or future reply, requiring a petition for an extension of time under this paragraph for its timely submission, 
as incorporating a petition for extension of time for the appropriate length of time. An authorization to 
drerge all required fees, fees under § 1.17, or all required extension of time fees will be treated as a 
constructive petition for an extension of time In any concurrent or future reply requiring a petition (or 
an extension of time under this paragraph for Its timely submission. Submission of Uw fee set forth in 
§ 1.1 7(a) will also be treated as a constructive petition for an extension of time in any concurrent reply 
requiring a petition for an extension of time under this paragraph for its timely submission.' 37 C.F.R. 
§ 1. 136(a)(3). 

□ 37 C.F.R. § 1.10 (Issue fee at or before mailing of Notice of Allowance, 
pursuant to 37 C.F.R. § 1.311(b)) 

Wltere an authorization to cfiargo tlx) issue fee to a deposit account has been filed before l/te mailing 
of o Notice of Allowance, the issue fee will be automatically charged to the deposit account at the time 
of mailing the notice of allowance. 37 C.F.R. § 1.311(b). 
NOIE: 37 C.F.R. § 1.28(b) requires 'NotiFication of any change In status resulting In loss of entitlement to small 
entity status must be filed in the application . . . prior to paying, or at Ihe time of paying, . . . the issue 
fee. . . ' From tlte wording of 37 C.F.R. § 1.28(b), (a) notification of change of status must be made 
even if tlte fee is paid as 'other than a small entity' and (b) no notification is required if the change 
Is to anotlier small entity. 
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16. JnstrucUom as to Overpayment 

NOTE: . . Amounts of twenty-five dollar* or less will not be returned unless specifically requested within 
a reasonable time, nor will the payer be notified of such amounts; amounts over twenty- five do/tars may 
be returned by check or, If requested, by credit to a deposit account." 37 C.F.R. § 1.26(a). 

H Credit Accounl No. 1G-1350 

□ Refund 



SEND ALL CORRESPONDENCE TO: 



Reg. No. 24.62Z 



SIGNATURE OF PRACTITfONEI 
Clarence A. Green 




[type or print name of attorney) 



Tel. No. ( 203 ) 259-1000 



PERMAM * GREEN, LLP 



P.O. Address 



Customer No. 



425 Post Road, Fairfield, Connecticut 06430 
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D Incorporation by reference of added pages 

(check the following Hem If the application In this transmittal claims the benefit of 
prior U.S. applicalion(s) (including an International application entering the U.S. 
stage as a continuation, divisional or C-l-P application) and complete and attach 
(he ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF 
PRIOR U.S. APPLICATIONS) CLAIMED) 

□ Plus Added Pages for New Application Transmittal Where Benelit of Prior U.S. 
Application(s) Claimed 

Number of pages added 

□ Plus Added Pages for Papers Referred lo in Item 4 Above 

Number of pages added 

□ Plus added pages deleling names of invenlor(s) named in prior applicallon(s) 
who is/are no longer Invenlor(s) of the subject matter claimed In this application. 

Number of pages added 

□ Pius "Assignment Cover Letter Accompanying New Application" " 

Number of pages added 

[XI Statement Where No Further Pages Added 

(if no further pages form a part of this Transmittal, then end this Transmittal with 
this page and check the following item) 
QD This transmittal ends with this page. 
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PAT 98031 US 



Image Sensor 

Background of the Invention 

5 

The present invention relates to video image sensors, and more particularly to 
colour and light sensing in relation to such sensors. 

Red, green and blue (RGB) are three primary additive colours whereby 
10 individual components are added together to form a desired colour and this 
format is the basic colour space model which is widely used throughout 
imaging. In particular, broadcast, video and imaging standards make use of 
RGB signals to derive luminance and colour difference video signals, such as 
YUV, YIQ or YCbCr colour spaces. Colour spaces are mathematical 
15 representations of a set of colours. In YUV, Y represents the black and white 
information in the video signal (i.e. luminance), and U and V represent the 
colour information in the video signal (i.e. chrominance). The basic equations 
for converting between RGB and YUV are: 

y = 0.299fl + 0.587G + 0.1145 
U = -0. 147 R - 0.289G + 0.4365 
20 17 = 0.492(5-7) 

F = 0.615fl-0.515G-0.100B 
V = 0.877(7? - Y) 

In YIQ colour space, I stands for in-phase and Q stands for quadrature, which 
is the modulation method used to transmit the colour information; YIQ can be 
derived from YUV. YCbCr is a scaled and offset version of the YUV colour 
25 space. 



2 

Currently, in known colour video sensing devices such as video cameras, 
black and white pixel sensors are adapted to read colour information by 
disposing colour filters over the sensors, which sensors typically are CCD or 
CMOS sensors. A standard arrangement is for the pixels to be grouped in 2 x 
5 2 blocks, with diagonally opposite pixels being responsive to green light and 
the other two diagonally opposite pixels being responsive to blue and red light 
respectively. These are known as RGB filters. The reason why there are two 
green pixels is that more image information is present in green light. 

10 It has been noted that a problem of using such an arrangement of RGB filters 
is that it introduces a light attenuation of approximately 50:1 . The share of the 
pixels between green, blue and red filters means that there is only 25% of the 
black and white pixel sensors for each of the blue and red filters, and 50% for 
the green filters. The result is that the sensor loses a great deal of colour 

15 resolution. Attempts are made in the downstream processing of the sensor 
output to recover the original resolution and a common technique is 
interpolation of the sensor output information using complex proprietary 
algorithms. This in essence involves estimating by interpolation what the 
colour response might be at a given pixel location based on the sensor 

20 outputs from the pixels surrounding that given pixel. However, since 
interpolation is a very approximate calculation its effectiveness varies widely 
depending on the complexity of the algorithm. 

In addition, use of RGB filters leads to a reduction in sensitivity. Furthermore, 
25 there is also a reduction in the spatial resolution of the sensor, RGB colour 
filtering reducing resolution approximately by a factor of four. 

A solution to the problem of loss of sensitivity due to RGB filters is to increase 
the length of time that the sensors are exposed to the scene to be captured 
30 on video. However, the knock-on effect of this is that the camera is more 
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susceptible to shaking, and also blurring due to subject movement is more 
likely to occur. This is a particularly marked problem for CMOS sensors 
which are of much lower sensitivity than CCD sensors. Also, since sensor 
noise is additive, longer exposure periods results in higher noise floor, and 
5 thus the image signal is swamped. 

As mentioned previously, in general, resolution of the image is determined by 
interpolation. Since there are a greater number of pixels in the green colour 
band and since also green light contains greater image information, this is 
10 used to increase the effective resolution of red and blue sensors. The main 
problem with this technique is that it is highly dependent on the quality of the 
algorithm used and its complexity. Sometimes the quality of the red and blue 
information can be improved further using green information. 

15 Summary of the Invention 

The present invention is based on the observation that the human eye is not 
as sensitive to colours as it is to brightness. In light of this observation, it is 
proposed that instead of at the pixel level having red, green and blue filters 

20 mapping onto respective pixels, certain of the colour pixels be replaced by so- 
called 'grey' filters in which there are no colour filters associated with such 
pixels. Accordingly, the present invention resides in an image sensing device 
having an array of image sensors and a filter structure disposed in relation to 
the image sensors, the filter structure comprising blocks of filter groups, each 

25 group having a combination of one or more areas adapted so as to allow light 
to pass therethrough onto corresponding image sensors with colour filtering, 
and one or more areas adapted so as to allow light to pass therethrough onto 
corresponding image sensors without colour filtering. 



A key advantage of the present invention, is that because there are certain 
areas in the filter which will allow the incident light to pass through without any 
colour filtering, the attenuation of the light is greatly reduced and 
consequently sensitivity of the device is enhanced compared with known RGB 
5 filter image sensing devices. 

A further advantage of the present invention is that it is better suited to image 
compression because it provides for better compatibility with such 
compression techniques. This is because image compression systems such 

10 as MPEG and JPEG have similar luminance and chrominance requirements 
to that output from the sensors of the present invention. In particular, such 
compression standards reduce chrominance, while sustaining the same level 
of luminance. Because the grey resolution and colour resolution of an image 
sensor of the present invention is designed to match those of MPEG and 

15 JPEG compression standards, the signals output from the sensors require a 
minimal amount of additional signal conditioning for JPEG and MPEG 
compression. 

In the prior art, the sensors are in Beyer pattern and Beyer pattern causes 
20 image anomalies during conversion to RGB. At the pixel level these 
anomalies are not very significant because individual pixels are only 
marginally visible. However, when the image is enlarged, these anomalies are 
enlarged and spread over several pixels, thereby becoming more visible. 

25 Since the format of the image sensor of the present invention is in line with 
DCT (discrete cosine transform) based compression techniques, it will better 
scale when enlarged. Therefore, by means of the invention it is possible to 
use a lower pixel sensor count, and scale to produce similar quality to a larger 
pixel count Beyer sensor. 
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A further advantage is that since there is a direct measure of luminance by 
virtue of those areas of the filter where there are no colour filters, the grey 
pixels of the present invention offer a full resolution of the image and therefore 
there is a significant improvement in image quality. 

5 

Additionally the image sensor calculation of YUV is much simplified over 
known prior art systems. 

Brief Description of the Drawings 

10 

The present invention will now be described by way only of example with 
reference to the accompanying drawings in which: 

Figure 1 schematically illustrates a first embodiment of the present invention; 
15 Figure 2 schematically illustrates a second embodiment of the present 
invention; and 

Figure 3 schematically illustrates a third embodiment of the present invention. 
Detailed Description of the Invention 

20 

Referring initially to Figure 1, there is shown a filter group of a unitary block 
(10) from a repeating pattern of such blocks forming a filter structure in 
accordance with a first embodiment of the present invention. The filter 
structure is overlaid in relation to an array of pixel sensors of a video imaging 

25 device. The block (10) consists of six filter areas. Four of these are areas in 
which there are no colour filters overlaying the respective pixels and these are 
denoted Y (for ease of reference these will be referred to as grey sensors). 
There is one area denoted B which represents a blue filter and there is 
another area denoted R which represents a red filter. The Y areas 

30 conveniently are formed by apertured windows in the filter structure which 
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align with respective pixels sensors. In this embodiment the Y areas are 
generally square, although rectangular and other shapes are equally 
permissible, and they are arranged spaced from one another in a generally 
square configuration. The blue and red filters are disposed centrally in 
5 relation to the four square grey sensors and conveniently are triangular in 
shape, although again other shapes are equally permissible. 

The process involved in capturing a video image using the filter structure of 
the present invention begins by first starting exposure for the red and blue 

10 filters. As mentioned above, since chrominance filters are less sensitive to 
light than luminance filters it is necessary to expose them for longer exposure 
times than luminance filters. Sensor readings are then taken from the four 
grey sensors by sampling them. While reading the luminance response the 
chrominance filters are subjected to extended exposure time. Next, the red 

15 and blue pixels are sampled. This series of steps is repeated for each block 
and involves reading a row of pixel sensors, resetting and looping. Typically, 
the refresh rate is 30 frames per second and is sequential. 

Since in known RGB arrangements the green filters occupy 50% of the filter 
20 space in a 2 x 2 block, it is proposed that in this embodiment the Y areas also 
occupy half of the filter space in a block, and because there are a group of 
four Y areas in each block, this can be expressed as fraction 4/8 of the overall 
filter space in each block. As there is no colour filtering in these Y areas the 
grey sensors are 50 times more sensitive and thus the overall sensitivity of 
25 the block is increased by 4/8 x 50 giving 25 times the sensitivity of prior art 
RGB filters. It should be mentioned that in order to achieve the same overall 
area of filter block as RGB filters, as there are four Y areas in place of two 
green filters, the size of each of the Y areas is reduced by 50% in comparison 
to green filters. 
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It was explained above that the blue and red pixels have four times the 
exposure time and this produces four times the amplitude. Effective 
sensitivity will therefore be increased fourfold and thus could allow for a 
reduction in filter size over known blue and red filters. 

5 

So for this embodiment, the relative areas are four Y areas each at 1/8 of the 
overall size, one blue at 2/8 of the overall area and one red pixel again at 2/8 
of the overall area. YUV is then given by the following set of equations: 

10 



Luminance for pixel 1 


Y1 


= Greyl - 2R - 3B 


Luminance for pixel 2 


Y2 


= Grey2 - 2R - 3B 


Luminance for pixel 3 


Y3 


= Grey3 - 2R - 3B 


Luminance for pixel 4 


Y4 


= Grey4 - 2R - 3B 


Blue chrominance 


U 


= 3B - (greyl + grey2 + grey3 + grey4)/8 


Red chrominance 


V 


= 6R - 0.9 x (greyl + grey2 + grey3 + grey4)/4 



The reduction in signal amplitude for red and blue pixels is not significant, with 
1/6 of full scale 12 bit (256), providing AID values 0 to 42; this is particularly 
20 so given that image compression algorithms reduce resolution below this 
during quantisation. However, to correct for this there could be an increase in 
size of red and blue pixels, and for example doubling their filter areas would 
increase A/D range to 84 and affect sensitivity by 16 times that of standard 
RGB filtered sensors. 

25 

The above estimates are model values ignoring fill factor, which is concerned 
with the amount of associated silicon in the sensor chip dedicated to 
processing and which will effectively reduce as a result of this method. If grey 
pixels are same size as black/white, and fill factor is 25% for the latter, then 
30 the table below outlines the unit area for each sensor block. 
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black/white GreyRB 
Pixels 4 8 

Associated local circuitry 12 1 8 
Total area for GreyRB 16 26 
5 Absolute fill factor 25% 31% 

Corrected fill factor* 1 5% 

* allowing for the fact that only four of the eight pixels are for luminance 
Therefore 25 fold increase in sensitivity is likely to be 15%/25% x 25 = 15:1 
increase in sensitivity. The likely increase in silicon could be 26/16 times the 
10 size, ie. 62% larger. However, the sensor array is only around 50% of the total 
silicon area, and therefore this equates to a 31% area increase. 

Figure 2 illustrates an alternative embodiment in which the red and blue filters 
of the block (20) are provided in strip like bands separating pairs of Y areas 

15 disposed above and below the bands. It is envisaged that the manufacture of 
such a filter structure would be much simplified because the ease of forming 
the red and blue bands would be increased because of less stringent 
alignment requirements of colour filters in relation to the pixel sensors. The 
manner in which this embodiment works is similar to the embodiment of 

20 Figure 1, although because of the different filter structure the specific 
mathematics of the filter sizes and sensitivity calculations are different. Such 
calculations being readily derivable by those skilled in the art based on the 
equations provided above. 

25 A third embodiment (30) of the present invention is illustrated in Figure 3. In 
this embodiment green (34) and red (32) stripped filters are disposed 
lengthwise across the Y areas (and grey pixels) which are disposed in a 
generally square configuration as in the previously described embodiments. 
This embodiment is similar to that of either of Figures 1 or 2 in that for each 

30 block there are four grey sensors disposed in a square configuration around 
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centrally disposed red and blue colour filters, the addition being that of the 
green and red stripped filters across the Y areas. Whilst the grey sensors in 
this embodiment still take a direct measure of luminance they are corrected 
for red and blue by the green and red strips and therefore provide a measure 
5 of luminance without the need for any calculation as required in embodiments 
for Figure 1 and 2. In other words, the green and blue strips correct for the 
influence of the central red and blue filters and accordingly yield direct Y 
measurements. 

10 The present invention may be embodied in other specific forms without 
departing from its essential attributes. For example, different specific 
configurations of the various colour/non-colour areas are possible giving 
analogous results. Accordingly reference should be made to the appended 
claims and other general statements herein rather than to the foregoing 

1 5 specific description as indicating the scope of invention. 

Furthermore, each feature disclosed in this specification (which term includes 
the claims) and/or shown in the drawings may be incorporated in the invention 
independently of other disclosed and/or illustrated features. In this regard, the 
20 invention includes any novel features or combination of features disclosed 
herein either explicitly or any generalisation thereof irrespective of whether or 
not it relates to the claimed invention or mitigates any or all of the problems 
addressed. 

25 The appended abstract as filed herewith is included in the specification by 
reference. 
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What is claimed is:- 

1 . An image sensing device having an array of image sensors and a filter 
structure disposed in relation to the image sensors, the filter structure 

5 comprising blocks of filter groups, each group having a combination of one or 
more areas adapted so as to allow light to pass therethrough onto 
corresponding image sensors with colour filtering, and one or more areas 
adapted so as to allow light to pass therethrough onto corresponding image 
sensors without colour filtering. 

10 

2. An imaging device according to claim 1, wherein said one or more 
areas adapted so as to allow light to pass therethrough onto corresponding 
image sensors with colour filtering comprise two colour filters. 

15 3. An imaging device according to claim 2, wherein the two colour filters 
are one each of red and blue filters. 

4. An imaging device according to claim 1, wherein said one or more 
areas adapted so as to allow light to pass therethrough onto corresponding 

20 image sensors without colour filtering comprise four filterless areas. 

5. An imaging device according to claim 1, wherein said one or more 
areas adapted so as to allow light to pass therethrough onto corresponding 
image sensors without colour filtering comprise four non-colour filters. 

25 

6. An imaging device according to claim 1 , wherein the arrangement of 
said areas in each block of filter groups in the filter structure comprises 
stripline formation of said respective areas. 
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7. An imaging device according to claim 1 , wherein the image sensors are 
CMOS sensors. 



8. An imaging device according to claim 1, wherein said one or more 
5 areas adapted so as to allow light to pass therethrough onto corresponding 

image sensors without colour filtering include one or more colour filters 
disposed at least partially thereover. 

9. An imaging device according to claim 8, wherein said one or more 
10 colour filters disposed over the one or more areas adapted to allow light to 

pass therethrough without colour filtering comprise colour filter strips. 

10. An image sensing device according to claim 1, wherein said colour 
filtering areas are disposed centrally in the filter group and said areas without 

15 colour filtering are disposed in a generally square like configuration around 
the central colour filters. 
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Abstract 

This invention discloses a filter structure for a video image sensing device. 
The filter structure consists of a red colour filter and a blue colour filter and 
5 these are combined in a sensing block with non-colour or apertured windowed 
sensors i.e. grey sensors. 
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